Following Mark Zuckerberg’s recent announcement of new AI features for the company’s (Ray-Ban) Meta glasses, we look at where we’re at and where things are heading with Meta’s VR/AR glasses.
What VR/AR Glasses?
Meta’s VR/AR glasses are part of the company’s push into the immersive world of virtual and augmented reality, which it envisions as a key part of the “metaverse.” The metaverse concept, which many of us will remember, was first announced back in October 2021 (when Facebook rebranded as Meta and caused stock values to fall as investors didn’t understand it), was Meta’s vision of a shared, immersive virtual space where people can interact, work, play, and socialise using VR, AR, and other digital technologies.
The VR/AR glasses are part of a range of products representing Meta’s attempt to lead in the next generation of computing by combining the physical and digital worlds. Meta aims to integrate AR glasses into everyday life, much like smartphones today, thereby enabling users to interact with virtual worlds alongside the real world. Consequently, Meta is investing heavily in AR and VR development.
What Are The Key Products?
The two key products in Meta’s range of VR / AR glasses are:
1. The Meta Quest Series (VR and now MR)
Meta Quest series devices are designed to allow users to fully immerse themselves in digital environments and are used for gaming, social interaction, education, and even workplace collaboration. Meta Quest 2 (formerly Oculus Quest 2) released in 2020, is Meta’s most successful virtual reality headset, offering an immersive VR experience without requiring a PC or external hardware. It features a standalone design with access to VR games, apps, plus social experiences, and is widely used for both entertainment and work-related VR applications. Also, the Meta Quest 3 model, released in 2023, introduced mixed reality (MR) capabilities, i.e., it blends both VR and AR features – is a step towards true augmented reality, where users can see both the physical world and digital overlays at the same time. It includes improved performance, better visual quality, and a slimmer design than its predecessor, supporting full-colour AR experiences through the usage of external cameras.
The latest news from Meta Connect 2024 included an announcement of the Meta Quest 3S, a more affordable version of the Quest 3, priced at $299. The Quest 3S is a mixed-reality headset, offering many features of the original Quest 3 but at a lower cost to make it more accessible to a wider audience. This device is part of Meta’s ongoing effort to dominate the VR/AR market by offering a range of headsets catering to different price points. At Meta Connect 2024, the company also introduced its Hyperscale VR App, known as Horizon Hyperscape for Meta Quest 3 users. This app allows users to explore photorealistic 3D environments created from real-life spaces using a technique called ‘Gaussian Splatting’, not traditional photogrammetry. For example, with the app, users can walk through virtual spaces as if they were physically present, making it an immersive experience. While users can’t yet upload their own scans, this feature is expected in the future, expanding creative possibilities in VR.
2. Meta Ray-Ban
As part of a project believed to date back to 2017 (first introduced in 2021 and then re-introduced and updated in September 2023), ‘Ray-Ban | Meta Smart Glasses’ are Meta’s smart glasses (developed in partnership with EssilorLuxottica) and premium sunglasses brand Ray-Ban. While they don’t offer full AR or VR capabilities like the Quest devices, they include cameras and audio features that allow users to take photos, videos, and listen to music. Users can also choose between 150 different custom frame and lens combinations, and users can livestream from the glasses to Facebook or Instagram, and use “Hey Meta” to engage with Meta AI (Meta’s advanced conversational assistant), just by using their voice. These glasses are more of a step towards a future where (Meta hopes) AR could be seamlessly integrated into everyday eyewear. Incidentally, price-wise, at the time of writing this article, Ray-Ban Met Wayfairer smart glasses retail at prices between £299 and £379.
Most recently (September 25), Meta’s CEO Mark Zuckerberg announced a number of new improvements to the glasses, the key ones being:
– Enhanced AI capabilities. Meta says users can now interact with Meta AI more seamlessly through the glasses, asking follow-up questions without having to repeat the trigger phrase. The glasses can also remember tasks (such as parking locations) and allow users to set reminders hands-free. Also, ‘Meta AI’ can now help with real-time assistance, such as identifying landmarks while exploring a city or assisting with grocery shopping by suggesting recipes based on items that the user is looking at through the glasses.
Recently (also at Meta Connect 2024), Mark Zuckerberg announced that Meta AI (the company’s series of artificial intelligence models and technologies) is one of the most used AI assistants across the world with “almost” 500 million monthly active users. This may be mostly thanks to India being Meta AI’s biggest market (via WhatsApp’s 500 million users located there). By comparison, OpenAI’s ChatGPT, for example, has 200 million weekly users.
– Real-time language translation. Mark Zuckerberg says the glasses will soon offer live translation for Spanish, French, and Italian, allowing users to hear translated speech through the open-ear speakers, making them ideal for travel and overcoming language barriers.
– Expanded music and audio partnerships. Meta’s enhancing integrations with Spotify and Amazon Music, while introducing new partnerships with Audible and iHeartRadio. Users can now control these platforms via voice commands and access additional content information, adding to the overall entertainment value.
– QR Code Scanning. Users can use the glasses to scan QR codes or phone numbers, and the content will automatically open on the user’s phone without needing any additional steps. Users just need to ask the glasses to perform the scan, and it will instantly transfer the data to their mobile device.
– New design and lenses. Meta has also introduced a limited edition Shiny Transparent Wayfarer frame and UltraTransitions® GEN S™ lenses, offering stylish options that adapt to different lighting conditions, blending fashion and function.
Looking Ahead – Next Generation
Looking ahead, ‘Project Aria’ is Meta’s experimental research platform for AR glasses. While Meta hasn’t fully released consumer-grade AR glasses (beyond the Meta Ray-Bans’ limited features), the company’s long-term vision is to develop AR glasses that can overlay digital information onto the physical world seamlessly, allowing for interactions with holographic objects, navigation aids, and enhanced communication tools. Project Aria’s output is not yet available to consumers, but the project is focused on developing advanced AR technology that could eventually be integrated into future consumer products. Currently, these glasses are used by Meta employees to collect data and study how AR can work in real-world scenarios.
Orion AR Glasses
The research and insights gained from Aria (over a decade) have fed into the development of Orion AR glasses (currently available to developers only). Introduced during Meta’ recent Meta Connect event (September 27), these are Meta’s most advanced prototype in augmented reality (AR).
Meta has said that one key feature that the Orion AR glasses (similar to Snap’s ‘Spectacles 5’) will be a “neural interface”, i.e. a wrist-worn wearable / peripheral that allows users use gestures to navigate around apps on the paired Orion glasses. Meta’s boss Mark Zuckerberg says that Orion is “the first device that is powered by our wrist-based neural interface”, i.e. it essentially allows users to send a signal from their brain to Orion. Orion AR glasses will also be controlled by voice prompts to Meta AI.
Meta has also said that Orion AR glasses have “the largest field of view (FOV) in the smallest AR glasses form to date” which the company says, “unlocks truly immersive use cases for Orion, from multitasking windows and big-screen entertainment to life-size holograms of people”. It’s been reported that the costs for building Orion AR glasses are currently very high at $10,000 per unit (it’s still a prototype). However, Meta says: “Orion isn’t just a window into the future – it’s a look at the very real possibilities within reach today. From Ray-Ban Meta glasses to Orion, we’ve seen the good that can come from letting people stay more present and empowered in the physical world, while tapping into all that the digital world has to offer”.
Competitors
Meta certainly isn’t the only company investing in VR/AR Glasses. Some of it’s key competitors in this area include:
– Apple Vision Pro. Announced in 2023, Apple’s mixed-reality headset offers a blend of AR and VR, with ultra-high-resolution displays, advanced spatial audio, and seamless integration with Apple’s ecosystem. Expected to release in 2024.
– Microsoft HoloLens 2. Focused on enterprise solutions, HoloLens 2 is an AR headset offering immersive mixed-reality experiences, particularly useful in industrial and medical applications.
– Magic Leap 2. Again, aimed at enterprise markets, this AR headset delivers high-quality visual computing, used in fields like healthcare, training, and manufacturing.
– PlayStation VR 2. Sony’s VR headset, released in 2023, focuses on high-quality gaming experiences, integrated with PlayStation 5, featuring advanced tracking and haptics.
– Pico 4. From ByteDance, this is a standalone VR headset, offering similar features to Meta’s Quest line but with a focus on global gaming and entertainment markets.
– Google Glass Enterprise Edition 2. Originally designed for consumers, Google Glass transitioned to an enterprise tool. It features a small heads-up display, allowing professionals to access critical information hands-free in industries like healthcare, manufacturing, and logistics.
– Amazon Echo Frames. Focused on audio rather than AR, Echo Frames are smart glasses with built-in Alexa. They allow users to control smart devices, listen to music, and receive notifications via voice commands without obstructing vision.
– Razer Anzu. Razer’s smart glasses are designed for both audio and protection. They offer open-ear audio and blue-light filtering lenses for gamers and those using screens for long periods.
– Bose Frames. These smart glasses feature built-in speakers for music and phone calls, offering a discreet, stylish way to consume audio without the need for headphones.
What Does This Mean For Your Business?
As Meta continues its journey toward building the future of virtual and augmented reality, its efforts reflect an evolving strategy that balances immediate consumer products with long-term innovation. The introduction of the Meta Quest 3S, Ray-Ban Meta glasses, and the development of the Orion AR glasses illustrate Meta’s commitment to the idea of making VR/AR more accessible, versatile, and integrated into everyday life. Each product, from the Quest’s immersive gaming experiences to Ray-Ban’s fashionable, AI-powered wearables, represents steps toward that future, with Meta hoping it can be the leader in the VR/AR glasses space.
However, the challenges are not insignificant. Meta, of course, faces strong competition from tech giants like Apple, Microsoft, and Sony, all offering advanced mixed reality headsets or AR solutions. These competitors are pushing Meta to continually innovate, ensuring that its devices not only appeal to early adopters but also find a place in mainstream markets.
Looking ahead, Meta’s focus on the ‘metaverse’, enhanced AI capabilities, and the refinement of AR technology through projects like Orion suggests that the company envisions a world where virtual and real spaces can blend seamlessly. While there’s much development left to be done, especially in terms of cost, accessibility, and user experience, Meta’s current trajectory appears to position it as a key player in the future of immersive technology. The company’s apparent determination to transform everyday interactions through VR/AR technologies may ensure that we’re likely to see even more exciting advancements in the near future.
For businesses, Meta’s (and other companies’) VR/AR glasses hold significant potential to transform various industries. These devices could, for example, revolutionise training by offering immersive, hands-on simulations in fields like healthcare, manufacturing, and engineering, reducing costs and improving learning outcomes. In retail, AR glasses could enhance customer experiences by providing virtual try-ons or interactive product demos. Remote work and collaboration could also benefit greatly, with AR allowing teams to visualise 3D models, host virtual meetings, or even interact with life-size holograms, making communication more engaging and effective. By integrating these technologies, businesses can streamline operations, improve employee engagement, and offer innovative customer solutions, giving them a competitive edge in a rapidly digitising world.